Phrase Detectives
نویسندگان
چکیده
In this Chapter we discuss Phrase Detectives, a Game-With-A-Purpose (GWAP) for anaphoric annotation that has been one of the first GWAPs for corpus annotation and one of the most successful. We discuss the architecture of the game, evaluate its results in terms of quantity and quality of data, and explain how the data were used to create a publically available corpus that can be used to study anaphora and / or to train anaphoric resolvers.
منابع مشابه
Phrase Detectives: A Web-based Collaborative Annotation Game
Annotated corpora of the size needed for modern computational linguistics research cannot be created by small groups of hand annotators. One solution is to exploit collaborative work on the Web and one way to do this is through games like the ESP game. Applying this methodology however requires developing methods for teaching subjects the rules of the game and evaluating their contribution whil...
متن کاملThe Phrase Detective Multilingual Corpus, Release 0.1
The Phrase Detectives Game-With-A-Purpose for anaphoric annotation has been live since December 2008, collecting over 2.5 million judgments on the anaphoric expressions in texts in two languages (English and Italian) from around 9,000 players. In this paper we summarize our recent work on creating a corpus using these annotations.
متن کاملA new life for a dead parrot: Incentive structures in the Phrase Detectives game
In order for there to be significant improvements in certain areas of natural language processing (such as anaphora resolution) large linguistically annotated resources need to be created which can be used to train, for example, machine learning systems. Annotated corpora of the size needed for modern computational linguistics research cannot however be created by small groups of hand-annotator...
متن کاملPhrase Detectives Corpus 1.0 Crowdsourced Anaphoric Coreference
Natural Language Engineering tasks require large and complex annotated datasets to build more advanced models of language. Corpora are typically annotated by several experts to create a gold standard; however, there are now compelling reasons to use a non-expert crowd to annotate text, driven by cost, speed and scalability. Phrase Detectives Corpus 1.0 is an anaphorically-annotated corpus of en...
متن کاملUser Performance Indicators In Task-Based Data Collection Systems
When attempting to analyse and improve a system interface it is often the performance of system users that measures the success of different iterations of design. This paper investigates the importance of sensory and cognitive stages in human data processing, using data collected from Phrase Detectives, a textbased game for collecting language data, and discusses its application for interface d...
متن کامل